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I.  INTRODUCTION 
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For  product  evaluation,  life  testing  or  reliability  studies,  a 
one-sided  tolerance  limit  or  a variables  sampling  plan  Is  often 
required.  Typical  statements  that  may  require  these  techniques  are: 

(1)  at  least  a desired  proportion,  p^,  of  the  product  must  meet 
or  exceed  a lower  specification  limit,  L,  with  Yo  confidence 

or  (2)  at  least  a desired  proportion,  Pq,  of  the  product  must  not 
exceed  an  upper  specification  limit,  U,  with  Yq  confidence. 

; 

If  pn  is  taken  to  be  50%  in  a normal  distribution,  then  the  problem 
reduces  to  the  familiar  one  of  finding  a one-sided  confidence  limit 
for  p,  or  testing  a statistical  hypothesis  concerning  y.  The  problem 
under  consideration  here  is  the  general  problem  where  Pq  is  not  restricted 
to  be  50%. 

Consider,  for  example,  the  U.S.  Navy's  requirement  to  have  an  oil- 
water  separator  capable  of  producing  an  effluent  with  less  than  15  parts 

I 

per  million  (ppm)  of  oil  in  the  effluent  water  85%  of  the  time  with  95Z 

) 

confidence.  In  this  case,  Pq  - 85Z,  U - 15,  Yq  “ 95%  and  inferences 
related  to  the  mean  are  not  appropriate.  As  another  example,  suppose  one 
gallon  paint  containers  are  filled  by  a machine.  The  manufacturer  wishes 
to  be  95Z  confident  that  at  least  99Z  of  the  paint  containers  have  one 
gallon  or  more  in  them.  Here,  p^  - 99Z,  Yq  “ 95%  and  L - 1. 

These  problems  can  be  solved  using  either  a parametric  or  a nonparametric 
procedure.  In  this  report  it  has  been  assumed  that  a sample  x^,...,xn  is 
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available  from  a population  which  follows  a normal  distribution  with  mean 
2 2 

y and  variance  o (both  y and  a unknown) . Since  the  lognormal  distribu- 
tion can  be  transformed  into  a normal  distribution,  the  results  of  power 
and  sample  size  calculations  will  also  apply  to  the  lognormal  distribution. 

One  approach  that  could  be  used  in  this  situation  is  the  construction 
of  a one-sided  tolerance  limit.  For  example,  in  the  case  of  a specification 
limit  U that  must  not  be  exceeded,  an  upper  tolerance  limit  could  be  con- 
structed. An  upper  one-sided  tolerance  limit.  A,  is  a quantity  that  can 
be  calculated  from  the  sample.  This  quantity  is  determined  by 

Pr[Pr(X  < A)  > p0]  - yq.  (1.1) 

In  other  words,  after  an  observed  value  of  A is  calculated  for  a sample, 
there  would  be  Yq  confidence  that  P(X  <_  A)  is  at  least  pq.  The  proportion 
Pq  is  referred  to  as  the  coverage  and  y0  as  the  confidence  coefficient. 

In  the  oil-water  separator  example,  attention  would  be  on  the  prob- 
ability that  the  amount  of  oil  in  the  effluent  water  is  less  than  or  equal 
to  A.  The  value  of  A would  be  determined  such  that  this  probability  is 
at  least  85Z  with  95Z  confidence.  The  obvious  change  can  be  made  if  a 
lower  one-sided  tolerance  limit  is  required.  For  example,  in  the  paint 
container  illustration,  attention  would  be  on  the  probability  that  the 
amount  of  paint  in  the  container  is  at  least  A.  The  vslue  of  A would  be 
determined  such  that  this  probability  is  greater  than  or  equal  to  99Z  with 

95Z  confidence.  In  the  case  of  a lower  tolerance  limit,  p_  is  often  referred 

0 

to  as  the  reliability  of  the  product. 

Based  on  a random  sample,  A could  be  calculated  and  then  compared  with 
U or  L.  The  product  would  be  accepted  if  U > A for  an  upper  one-sided 
tolerance  limit  and  rejected  otherwise.  Similarly,  for  a lower  one-sided 


tolerance  limit,  the  product  would  be  accepted  if  A > L and  rejected 
otherwise.  If  the  product  just  meets  the  specification,  there  is  a 
probability  of  1 - Yq  °f  accepting  it.  For  values  of  Yq  that  are 
generally  used,  this  procedure  places  a large  risk  on  a product  being 
rejected  if,  in  fact,  the  product  just  meets  the  specification. 

Another  approach  to  this  problem  is  hypothesis  testing  by  means  of 
a one-sided  variables  sampling  plan.  This  is  a plan  which  guarantees 
that  at  least  a proportion  Pq  of  the  population  is  less  than  a given  value 
U with  a probability  Yq*  Specifically,  if  p ■ Pr[X  < U],  then  it  is 
desired  to  test  H^:  p < Pq  versus  H^:  P Pq*  If  a lower  specification 
limit  L is  required,  the  problem  can  be  described  in  similar  statements 
where  the  hypotheses  have  been  appropriately  altered. 

The  tolerance  limit  approach  and  the  variables  sampling  plan  approach 
to  the  problem  under  consideration  have  been  shown  by  Owens  [6]  to  be 
equivalent.  For  brevity,  the  case  of  an  upper  specification  limit  will 
be  assumed  throughout  the  remainder  of  this  report,  although  the  results 
also  apply  to  the  case  of  a lower  specification  limit. 
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value  of  k and  hence  the  tolerance  limit.  Values  of  k are  given  In 
many  statistical  tables,  and  approximation  formulas  are  also  available. 

See,  for  example,  Natrella  [S],  Owens  [6],  Eisenhart,  Hastay  and  Wallis 

tl]. 

Tolerance  limits  are  usually  used  in  estimation.  That  is,  given  p^ 
and  Yq  It  is  desired  to  estimate  y + ♦ ^(p^)o  with  Yq  confidence,  where 
4 is  the  standard  normal  cumulative  distribution  function.  However,  an 
upper  one-sided  tolerance  limit  may  also  be  used  to  test  a hypothesis  in 
the  situation  where  a specification  limit  U has  been  imposed  on  the  product.  ‘ 

The  procedure  is  to  conclude  that  the  specification  has  been  met  if 

i + ks  < U and  to  conclude  that  it  has  not  been  met  otherwise.  ! 

Guenther  [3]  linked  certain  one-sided  tolerance  limits  to  hypothesis 
testing.  He  showed  that  for  the  normal  distribution,  a test  based  on  the 
tolerance  limit  x + ks  is  the  uniformly  most  powerful  invariant  test. 
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II.  STATISTICAL  FRAMEWORK 


As  was  mentioned  previously,  the  problem  may  be  considered  as  a test 
of  the  hypothesis  H^:  p < Pq  versus  the  alternative  hypothesis 
H^:  P Pq  where  p • Pr[X  < U].  Equation  (1.2)  is  equivalent  to 

Pr[T(f ,6)  < kv£|fi  - ^(pq)^,  f - n - 1]  - y (2.1) 

where  T(f,fi)  is  a noncentral  t random  variable  with  f degrees  of  freedom 
and  £ as  the  noncentrality  parameter.  (For  a derivation  of  this  equivalence, 
see  Owens  [6].) 

In  hypothesis  testing,  it  is  customary  to  speak  in  terms  of  the  level 
of  significance  a ■ 1 - Yq  rather  than  the  confidence.  From  the  formulation 
of  the  problem  in  (2.1),  it  is  clear  that  k is  determined  by  p^,  n,  and  a 
(or  Yq)»  i.e.,  k is  determined  by  H^.  Under  the  alternative  hypothesis, 
only  the  noncentrality  parameter  £ is  changed. 

Consider  now  the  power  of  the  test.  It  is  a function  of  four  parameters 
and  can  be  written  as 

G(p0.  Yq,  P,  n)  - Pr [T(f ,£)  > k*£|fi  - *_1(p)^,  f - n - 1]  (2.2) 

Since  the  alternative  hypothesis  is  a one-sided  alternative,  it  is  only 
necessary  to  consider  the  power  for  values  of  p _>  p^. 

Before  the  power  can  be  calculated,  the  value  of  k must  be  determined. 
This  can  be  done  by  choosing  the  k which  minimizes 

(Pr[T(f,fi)  < kift|6  - *"1(po)^,  f - n - 1]  - y0>2- 


With  this  value  of  k,  the  calculation  of  the;  power  G(pg,  Yq»  Pi  n)  for 
various  values  of  p is  an  evaluation  of  the  probability  that  a noncentral 
t random  variable  is  greater  than  or  equal  to  k^n.  Tables  1 through  8 
present  the  values  of  G(p^,  Yqi  P»  n)  for  selected  values  of  the  parameters. 
All  calculations  were  carried  out  in  double  precision  using  the  IBM  370 
computer. 

Although  the  tables  are  given  in  terms  of  the  confidence  level  (Yq) 
and  the  power  (G),  some  experimenters  may  find  the  tables  easier  to  interpret 
in  terms  of  consumer's  and  producer's  risks.  The  consumer's  risk  in  this 
problem  is  the  probability  of  rejecting  Hq  and  accepting  the  product  when 
the  specification  limit  has  not  been  met.  This  is  the  level  of  significance 
of  the  test  and  is  controlled  at  a maximum  of  a.  The  producer's  risk  is 
the  probability  of  rejecting  the  product  when  it  does  meet  the  standard. 

This  can  easily  be  calculated  from  the  table,  since  this  is  the  probability 

of  a Type  II  error,  and  hence  is  equal  to  1 - G(p^,  Yq»  P»  n).  For  a given 

n and  Yq,  as  p - Pq  becomes  larger,  the  producer's  risk  becomes  smaller. 

It  should  also  be  emphasized  that  if  the  specifications  are  exactly 

met,  (p  - Pq),  and  the  test  is  conducted  at  a ■ 1 - Yq  level  of  significance, 

then  the  producer's  risk  is  Yq.  This  means  that  the  performance  must  Indeed 
be  better  than  the  stated  requirement  to  have  much  of  a chance  of  being 
accepted.  For  example,  if  80%  confidence  is  required,  then  the  producer's 
risk  is  80%  if  his  product  meets,  but  is  not  better  than,  the  stated  require- 
ment. In  this  case,  the  probability  is  80%  that  the  product  will  be  rejected, 
even  though  it  does  meet  the  standard. 
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Table  2:  Probability  of  Exhibiting  P(X  <_  U)  > p.  for  a Normal  Distribution  When 

the  One-sided  Tolerance  Limit  x + ks  is  Calculated  for  pn  = .80  and  Yr>  = *95 
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Table  5:  Probability  of  Exhibiting  P(X  < U)  > p for  a Normal  Distribution  When 
the  One-sided  Tolerance  Limit  x + ks  is  Calculated  for  pQ  - .90  and  Yq 
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Table  6:  Probability  of  Exhibiting  P(XiU)  > for  a Normal  Distribution  When 
the  One-sided  Tolerance  Limit  x + ks  is  Calculated  for  pg  - .90  and  yg 
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III.  APPLICATIONS 


These  results  can  be  used  in  a variety  of  situations.  In  general, 
the  tables  will  be  useful  to  any  experimenter  in  a situation  in  which 
the  test  statistic  follows  a noncentral  t distribution  under  both  the  null 
and  the  alternative  hypothesis,  with  the  difference  in  the  distribution 
being  only  a change  in  the  noncentrality  parameter  6.  Specifically,  the 
problems  that  have  been  considered  by  the  authors  are  related  to  tolerance 
limits  and  variables  sampling  plans.  The  following  examples  illustrate 
some  of  these  situations. 

Example  1:  Suppose  a consumer,  for  example,  the  U.S.  Navy,  requires 
an  oil-water  separator  system  capable  of  separation  such  that  not  more 
than  20  parts  per  million  (ppm)  of  oil  is  contained  in  the  water  effluent 
85%  of  the  time  with  95%  confidence.  Previous  experience  indicates  that 
the  distribution  of  the  amount  of  oil  in  the  effluent  water  follows  a 
lognormal  distribution.  A separator  system  is  put  on  test,  170  samples 

•V 

are  collected  and  analyzed.  The  natural  logarithms  of  the  observations 
were  found,  and  the  mean  and  standard  deviations  of  the  transformed  scores 
were  1.7542  and  0.8262  respectively,  With  k ■ 1.2036  taken  from  Table  4 
with  Pq  " .85  and  Yq  ■ .95,  it  is  found  that  x + ks  ■ 2.7487  which  is  less 
than  ln(20).  It  is  therefore  concluded  that  the  system  does  meet  the 
requirement . 
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Example  2:  If,  in  example  1,  the  requirement  had  been  that  the 
affluent  contain  not  more  than  15  ppm  of  oil  85%  of  the  time  with  95% 
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confidence,  the  system  would  have  been  judged  unsatisfactory  since 
2.7487  > ln(15).  After  examining  the  tables,  the  manufacturer  may  in 
return  have  argued  that  his  risk  in  this  situation  was  too  high.  If  his 
system  meets,  but  does  not  exceed  the  requirement,  he  faces  a 95Z  chance 
of  having  his  system  rejected.  In  fact,  his  system  must  produce  less  than 
15  ppm  of  oil  90Z  of  the  time  in  order  to  have  a probability  of  76Z  of 
being  accepted. 

Example  3:  Suppose  a lower  95Z  tolerance  limit  is  required  for  Pq  - 85Z. 
It  is,  of  course,  desirable  to  have  this  quantity  close  to  the  point  it  is 
estimating,  U + ♦ ^(1  - p^jo.  A method  of  measuring  this  closeness  and 
determining  sample  size  was  presented  by  Faulkenberry  and  Weeks  [2].  Using 
this  method,  a p > p^  and  a small  e > 0 would  be  chosen.  Then  the  sample 
size  would  be  determined  to  satisfy 

Pr[Pr (X  > x + ks)  > p]  < e. 

In  other  words,  the  probability  of  a Type  II  error  is  no  larger  than  t at 

A 

P. 

If  p ■ 96Z  and  e - 5Z  are  chosen,  the  power  at  96Z  must  be  at  least 
95Z.  In  Table  4,  it  is  seen  that  the  required  sample  size  is  between  40 
and  50.  Therefore,  a sample  size  50  is  adequate.  (Exact  calculation  can 
be  performed  using  the  techniques  of  the  previous  section.) 

It  should  be  noted  that  the  choice  of  p need  not  be  made  independently 
of  n.  A more  useful  procedure  would  be  for  the  experimenter  to  consult 
the  tables  and  choose  n by  examining  the  effect  that  an  increased  sample 
size  has  on  the  power  (or  Type  II  error).  In  this  way,  the  sample  size 
could  be  determined  with  the  knowledge  of  how  much  power  the  sample  size 
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"buys"  as  compared  to  a different  sample  size. 

] 

Another  example  was  suggested  by  Guenther  [4].  He  considered 
several  hypothesis  testing  situations  in  which  the  statistic  is  dis- 
tributed as  a (central)  t random  variable  under  the  null  hypothesis, 
and  as  a noncentral  t under  the  alternative  hypothesis.  One  of  the 
situations  considered  is  where  inferences  are  being  made  about  the 
mean  of  a normal  distribution.  He  determined  the  sample  size  by 
specifying  the  power  when  the  difference  between  the  mean  under  the 

null  hypothesis  and  the  mean  under  the  alternative  is  expressed  in  ‘ 

quantiles.  This  result  has  been  extended  in  this  report  to  include  the 
case  where  the  inference  is  to  be  made  about  any  given  quantile,  not 
necessarily  the  mean,  of  a normal  distribution. 
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IV.  SUMMARY 


In  this  technical  report,  tables  for  the  power  of  a one-sided 
statistical  hypothesis  test  are  presented  for  the  situation  in  which 
the  statistic  is  distributed  as  a noncentral  t under  both  the  null  and 
alternative  hypothesis.  Specifically,  power  and  sample  size  problems  are 
considered  for  a one-sided  tolerance  limit  and  for  a variables  sampling 
plan.  Examples  are  also  included  to  illustrate  how  these  tables  can  be 
used  in  hypothesis  testing  situations  and  for  determining  sample  size 
requirements  in  some  estimation  procedures. 
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